Papers with exact fact recall
Fact Recall, Heuristics or Pure Guesswork? Precise Interpretations of Language Models for Fact Completion (2025.findings-acl)
Copied to clipboard
| Challenge: | Language models (LMs) can make a correct prediction based on many possible signals in a prompt, but not all corresponding to recall of factual associations. |
| Approach: | They propose a model-specific recipe for constructing datasets with examples of four different prediction scenarios: generic language modeling, guesswork, heuristics recall and exact fact recall. |
| Outcome: | The proposed model-specific recipe yields distinct results for each scenario. |